arXiv:1507.08386vl [stat.ME] 30Jul2015 


Statistical Science 

2015, Vol. 30, No. 2, 167-169 

DOI: 10.1214/15-STS516 

Main article DOI: 10.1214/14-STS487 

(c) Institute of Mathematical Statistics, 2015 

On the Flexibility of Multivariate 
Covariance Models: Comment on 
the Paper by Genton and Kleiber 

Moreno Bevilacqua, Amanda S. Hering and Emilio Porcu 


INTRODUCTION 

We congratulate the authors for their considerable 
effort to collect and synthesize all of the information 
contained in this review paper. Given the breadth of 
models, we were particularly inspired by the idea of 
how a practitioner would choose among them. We 
define some general criteria of flexibility that should 
be considered when choosing between different mul¬ 
tivariate covariance models, and we apply these cri¬ 
teria in the comparison between the bivariate linear 
model of coregionalization (LMC) and the bivariate 
multivariate Matern. 

Which Model Is the Most Flexible? 

Since most of the contributions listed by the au¬ 
thors refer to parametric models of multivariate co- 
variances, we seek to answer the question, “which 
parametric model is more flexible?” We propose to 
define flexibility with respect to the following: 

(A) the colocated correlation coefficient, and 

(B) the strength of spatial dependence. For in¬ 
stance, how different can the scales of the cross¬ 
covariances and the marginal covariances between 
the two models be. 


Moreno Bevilacqua is Associate Professor, Department 
of Statistics, University of Valparaiso, Chile e-mail: 
moreno.bevilacqua@uv.cl. Amanda S. Hering is 
Assistant Professor, Department of Applied 
Mathematics and Statistics, Colorado School of Mines, 
Golden, Colorado 8O4OI, USA e-mail: 
ahering@mines.edu. Emilio Porcu is Professor, 
Department of Mathematics, Technical University 
Federico Santa Maria, Valparaiso, Chile e-mail: 
emilio .porcu@usm.cl. 

This is an electronic reprint of the original article 
published by the Institute of Mathematical Statistics in 
Statistical Science, 2015, Vol. 30, No. 2, 167-169. This 
reprint differs from the original in pagination and 
typographic detail. 


As far as (A) is concerned, ideally the colocated cor¬ 
relation coefficient should be defined over the inter¬ 
val [—1,1]. Let us consider models of the type 

(1) C(h) = [aiajPijR{\i] h e 

with R(-) being a parametric univariate correlation 
model in and Oij G A C being parameter vec¬ 
tors. Here af > 0, i = 1,2 are the marginal variances, 
and pi2 is the colocated parameter describing the 
correlation between the components of the bivari¬ 
ate random field at h = 0. The bivariate Matern [2] 
and Wendland [1] models are special cases of equa¬ 
tion (1). 

For the bivariate Matern case, the validity bound 
for pi2 is given in Theorem 3 of [2], and in gen¬ 
eral it depends on the smoothness parameters, 
^^ 22 ,and the scale parameters, a = 
(ail, 022 , 012 )^- For instance, assuming a constant 
smoothness parameter, and ai 2 < min(aii, 022 ), a 

necessary and sufficient condition for the validity 

2 

of the bivariate Matern becomes \p^2\ < —< 1- 
In the case where the scale and smoothness parame¬ 
ters are pairwise equal (i.e., the separable case), then 
I/O 12 I < 1, and there are no restrictions on the colo¬ 
cated parameter. These features are also present in 
the bivariate Wendland construction in [1], where 
the elements of the matrix-valued covariance are 
parameterized in the same way as the bivariate 
Matern. As the difference between the parameters 
ail and 022 increases, the bound on pi2 becomes 
tighter, as shown in Figure 1. 

The linear model of coregionalization (LMC) does 
not necessarily share this limitation on the colocated 
correlation coefficient. In order to illustrate this, we 
start with a simple example: for the following, we 
write R{-) := C'(-)/C'(0), for C some univariate co- 
variance function in Then, the bivariate LMC 
correlation model R(h) = [RijOc )]^h G can 
be written as 

Rii{h) = aliRiih) -\- ai2R2(h), 
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that we have an ill-posed problem because the colo¬ 
cated correlation coefficient’s upper bound is related 
to the scales. Thus, we analyze issue (B) for a fixed 
value of pi 2 . In particular, we try to address the 
question: “which model allows for bigger differences 
with respect to the strength of spatial correlation for 
a given colocated correlation coefficient?” We intro¬ 
duce here two multivariate measures that once again 
we illustrate for the bivariate case for ease of expo¬ 
sition. 

[(B.l)] Since we are dealing with isotropic models, 
we shall write R{t) instead of i2(||h||) for h G M'’*. For 
a given multivariate covariance model x, we define 


Fig. 1. The upper bound on p\2 as a function of Q 12 for 
various values of an and 022- Note that for the colored lines, 
an = 5. 


i?22(h)=o2,i?i(h) + ® 22 -^ 2 (h), and 

.Ri2(h) = aiia2i.Ri(h) -|- oi2a22-R2(h). 

The 2x2 matrix A = {aij} has rank 2. Here we 
focus, without loss of generality, only on positive 
correlations between the components, and, in order 
to do that, we consider >0 for i,j = 1,2. Let us 
now consider the special case ai 2 = 021 - Since ^2^(0) 
must be identically equal to one, we get, as necessary 
conditions, that ah + ah = 1 = ah + ah^ which in 
turn implies that necessarily an = 022 =: a. Then 
the previous system of equations can be rewritten 
as 

i2ii(h) = a‘^Ri{h) + (1 - ahR2(M), 

R220^) = (1 - a^).Ri(h) -I- a^R 2 {h.), and 

i?i 2 (h) = a\/l - a‘^{Ri{h) + i 22 (h)). 

In this case the colocated correlation coefficient is 
identically equal to pi 2 := i2i2(0) = 2a\/l — a? G 
[0,1] since o G [0,1]. Thus, the LMC seems to be 
more flexible than the bivariate Matern with respect 
to issue (A) since its colocated correlation coefficient 
is free to vary through the maximum extent of its 
possible range, regardless of the form of the marginal 
covariances. 

Issue (B) is clearly more critical to address, since 
it is not directly interpretable from the parameteri¬ 
zation. In particular, it would be nice to have models 
that allow for different levels of strength of spatial 
correlation, which is directly related to the scales. 
Clearly, the conditions on the bivariate Matern as 
well as those on the bivariate Wendland indicate 


(2) Vfj /,:=maxlRii(t)-Rkj(t)l, t := ||h|| > 0, 

where k G When k = j ^ i, Rfjj = ■ is 

a measure of the maximum difference between the 
correlation of the ith and jth components; while for 
k = i, Rfj • = Pf • j reflects the maximum difference 
between the cross correlation Rij and the correlation 
of the ith component. According to this criterion, for 
two given models x and y, with a common (fixed) 
colocated correlation coefficient pf 2 = P 12 ) if ^ j < 
then model y is preferable. 

The computation of the indicator above can be te¬ 
dious, depending on the functional forms of the in¬ 
volved marginal and cross correlations. For instance, 
for the bivariate Matern model, obtained when fix¬ 
ing the parameters uu, U 22 and U 12 to be identically 
equal to 0.5, the general form of the bivariate cor¬ 
relation function can be written as 0 < 1 1 —)• Rij{t) = 
Pije ~^°‘^^, aij >0, pii = l. In this case, inspection of 
equation (2) directly relates to finding the station¬ 
ary solution of the problem 


G{a,b,p) :=max|/(t,a,6,p)]. 


where f{t,a,b,p) = e““* — pe~^^, with a,6 > 0, and 
p could be a function of a and b but is fixed here 
and belongs to the interval [—1,1]. The case p <0 
is trivial since the maximum is attained at t = 0, so 
we focus on the case p > 0. The problem has the 
following solutions: 


(3) G{a,b,p) 


max(-/(r,a,6,p),l -p), 
if 6 < a, 
f{t*,a,b,p), 

if 6 > a, log p -I- log(6/a) > 0, 

1 -P, 

if 6 > a, log p -I- log(6/a) < 0, 






COMMENT 


3 


where t* = , Pqj- l) = a, G{a, b,p) = 1 — p. 

For the bivariate exponential model, we can com¬ 
pute 

PgP =G(«ii,«22,1) 

0, ail = 022, 

/log(a22/aii) A 

-J -,an,022,1 , 

\ 022 — ail / 

if 022 < ail, 

Ylog(o22/aii) 


= 


/ 




022 — Oil 
if 022 > Oil- 


-, 011 , 022 , 1 


Similarly, PfYi ^2 2^1 computed using 

equation (3) as G(aii, 012 ,/O 12 ) and ^( 022 , 012 ,pn)- 
Note that F>|^ 2*2 does not depend on the colocated 
correlation coefficient and that, for this example, 0 < 
^f ?2 — and, similarly, we have 0 < F’J^Yi — 1- 
Let us now analyze a special case of the LMC 
model as illustrated through issue (A), supposing 
that Ri{t) =exp(—ot) and R 2 {t) =exp(—/3t), for o 
and /3 positive. Direct inspection shows that in this 
case VY ^2 = fc|2a^ — 1|, where k = G{a,l3, 1). Now, 
we note that pu = 2aVl — o? for 0 < a < 1 and, as 
shown before, pi 2 can belong to any value inside the 

interval [0,1]. Since a = RYpp = 

^v^i -pL < — /5^2, with equality if and only if 

pi 2 = 0. Similarly, it can be shown that < 

1 - pi 2 and ^ 1 “ P 12 • 

Comparing the index between the bivariate LMC 
and exponential model, when pi 2 1, then VY 22 < 
'Ri^ 2 - Ttius, it seems that more flexibility is offered 
by the bivariate exponential at least for the marginal 
correlations Ru and R 22 - 

[(B.2)] As a second indicator for a given multivari¬ 
ate covariance model x, we propose 


(4) 



Rkj{t))dt 


For instance, let us consider the case of the radial 
part of a bivariate Matern model, so that 


Rijit') — Piji.O^ijt') (Ojj't), 

for which direct inspection shows that 
/ FYn + (l/2)) 

V aiiF(z^ii) 

Pl 2 ^{k>i 2 + (1/2)) \ 

ai2F(z^i2) ) 


^1,1,2 — 


i >0, 


Observe that in a bivariate exponential model, we 
easily get ^^^2 = lai"/ “ /Oi2aYl, and ^^^2 = 
An “ ®^2 I does not depend on the colocated 
correlation coefficient (as in the previous index). 
For the LMC model we easily get that D ^^2 = 
■\/l — pf 2 the exponentials as as¬ 

sumed earlier. As with the first index when pi 2 —^ 1, 
< ^^ 2 ^ 2 - Again the bivariate exponential 
model seems to be more flexible with respect to 
LMC, at least when comparing the marginal corre¬ 
lations Rii and i? 22 - 


CONCLUSION 

Comparing multivariate covariance models from a 
flexibility point of view is an important issue, since 
it can be helpful when choosing between the set of 
parametric models described in this review paper. In 
this discussion we have proposed two possible crite¬ 
ria in order to define the ffexibility of a multivariate 
covariance model. Using the criteria proposed, we 
compare the flexibility of the LMC with the multi¬ 
variate Matern in the bivariate case. There is a clear 
trade-off between the two models. In particular, the 
LMC is more flexible in terms of the allowable in¬ 
terval for the colocated correlation coefficient, which 
varies freely over the interval [—1,1]. Instead, the 
bivariate Matern has restrictions on the permissi¬ 
ble range of the colocated correlation for given spa¬ 
tial scales and smoothness parameters. On the other 
hand, the two indices highlight that if the colocated 
correlation is the same for the two models, the bi¬ 
variate Matern has more flexibility as the colocated 
correlation tends to 1. 

In conclusion, we believe that more work should 
be done in order to compare multivariate models 
from a flexibility viewpoint. In this discussion, we 
have offered some instruments that might be useful 
in this direction. 
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